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APSTRACT 


This  voluae  defines  the  capabilities  of  NIPS  360  FFS 
Utility  (UT)  components.  It  describes  the  function  of  each 
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for  the  knowledgeable  user  of  these  components. 

This  document  supersedes  CSM  UM  158-68,  Volume  VII. 

CSM  UM  15-74  Volume  VII,  is  part  of  the  fcllcwing 
additional  NIPS  360  FPS  documentation: 


CSM  UM  15-74 


TR  5 4-74 
CSM  GD  15-74 


Vol. 

I 

Vol. 

II 

Vol. 

III 

Vol. 

IV 

Vol . 

V 

Vol. 

VI 

Vol. 

VIII 

Vol. 

IX 

Introduction  to  File  Concepts 
File  Structuring  (FS) 

File  Maintenance  (FM) 

Retrieval  and  Sort  Processor  (RASP) 
Output  Processor  (OP) 

Terminal  Processing  (TP) 

Job  Preparation  Manual 
Error  Codes 

Installation  of  NIPS  360  FFS 
General  Description 


vi 


CH-2 


utility  Support  (UT) 


For  example,  the  following  table  value  statements 
would  supply  ar gument/funct ion  pairs  to  a "Service 
Table": 

E U.S.  Coast  Guard 

M U.S.  Army 

J U.S.  Air  Force 

N U.S.  Navy 

M U.S.  Marine  Corps 

The  order  of  argument/f unct ion  pairs  in  the  example  shown 
remains  consistent  in  each  table  value  statement.  However, 
column  selection  of  data  value  placement  is  free  format.  In 
this  format  the  fixed  length  field  cannot  contain  embedded 
blanks,  but  the  variable  length  field  can. 


2.2  Job  Setup 

a.  The  following  job  setup  is  used  to  execute  the 
XTABGEN  cataloged  procedures  and  must  be  organized 
in  the  order  shown: 

//Jobneime  JOB  (Standard  parameters) 

//Stepname  EXEC  XT AEGEN,LIB=yourlib 

//TAB.STSIN  DD  * 

TABLE  IDENTIFICATION  STATEMENT  (Required) 

HEADR  STATEMENT  (Optional) 

COMMENT  STATEMENT  (Optional) 

TABLE  VALUE  STATEMENTS  (Required) 

/♦ 

b.  More  than  one  table  may  he  generated  in  a single 
job  step.  If  tables  are  batched  and  a table 
argument  length  exceeds  30  bytes,  TABGEN  must  be 
informed  by  stating  the  maximum  argument  length  in 
the  FARM  field  of  the  EXEC  card,  for  example, 
PARH  = nnn  (nnn  is  any  number  between  1 and  255). 

c.  The  generated  table  will  become  an  executable  load 
module  which  will  reside  as  a member  of  a library 
that  will  be  identified  by  the  LIB=  parameter  in 
the  EXEC  card.  The  user  nay  create  his  own  new 
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licrary  by  overriding  the  following  syubclic 
parameters: 

LIBDISP=  (NEW, KEEP) 

VLIB=  (volume) 

LIBS?=  (space) 

ULIB=  (unit) 

2.3  Limitations 

# a.  The  maximum  table  size  is  approximately  528,000 
bytes.  The  maximum  number  of  pages  which  any  table 
may  contain  is  132. 

b.  The  maximum  argument/function  size  is: 

o.  256  bytes  when  using  keyword  table  identification 
statements 

o.  80  bytes  when  using  fixed  cable  identification 
statements. 


2.4  Examples 

Examples  cf  test  runs  using  keyword  table  identification 
sta  temen  ts. 

a.  The  following  TABGEN  source  deck  setup  was  used  to 
generate  a f ixed- to- va  riab  le  length  table  using 
free  format  table  value  statements.  The  table  name 
is  CTRYS,  and  the  table  converts  a two-character 
internal  storage  code  to  an  output  value  with  a 
Baximum  length  of  15  characters.  The  user  naae  is 
TABGENTEST  and  the  table  page  size  is  2,000 
characters. 

//Jctname  JOB  (standard  parameters) 

//STEPA  EXEC  XTABGEN, LIB=yourlit 

//TAB.SYSIN  DD  * 

TABLE=CTFYS  ARG  = 2 FUNC=15  USE=0  PAGE=2K  TABGENTEST 
• TABLE  CTBYS  USING  FREE  FORMAT  TABLE 
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**  IDENTIFICATION  CARD  AND  TABLE  VALUE 
***  CARDS. 

AA  AFRICA 

AC  ATLANTIC  OCEAN 


64  CARIEEEAN 

65  PACIFIC  ISLANDS 

/♦ 

The  output  listings  for  this  source  deck  will 
will  as  follows: 

DATE  71001  TAELE-CTRYS  ORIGINATOR  TABGFNTEST  PAGE-001 

TABLE  CTRYS  USING  FREE  FORMAT  TABLE 
IDENTIFICATION  CARD  AND  TABLE  VALUE 
CARDS  . 

ARGUMENT  FUNCTION 


AA  AFRICA 

AC  ATLANTIC  OCEAN 


€4  CARIBBEAN 

65  PACIFIC  ISLANDS 

b.  The  following  TABGEN  source  deck  setup  was  used  to 
generate  a variable-to-fixed  length  conversion 
table  using  fixed  foraat  table  value  stateaents. 
The  table  name  is  UNLVSI,  and  the  table  is  used  to 
convert  an  external  value  with  a maximuBi  length  of 
15  characters  to  an  input  storage  code  with  a 
maximum  length  of  three  characters.  The  user  name 
is  TABGENTEST  and  the  table  page  size  is  1,000 

b ytes: 

//Jobnaae  JOB  (standard  parameters) 

//STSPA  EXEC  XTABGEN,LIB=yourlib 

//TAB.SYSIN  CD  ♦ 

TABLE=UNLVSI  AHG=10/24  FUNC=1/3  USE=I  '^ADGENTEST 
* TABLE  UNLVS  USING  KEYWORD  TABLE  IDENTIFICATION 

♦♦  STATEMENTS  AND  FIXED  FORMAT  TABLE  VALUE 
CARDS. 
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A 

SOMBEKED  ARMY 

ACD 

ACADEMY 

U 

UNIT 

USS 

US  SHIP 

WG 

WING 

/♦ 

The  output  listing  for  this  source  decJc  will 
appear  as  follows: 

D.JlTS  71007  TABLE-UNLVSr  ORIGIN  ATOR-TABGSNT2ST  PAGE-001 

TABLE  UNLVS  USING  KEYWORD  TABLE  I B ENTI f IC ATION 
STATEMENT  AND  FIXED  FORMAT  TABLE  VALUE 
CARDS . 


ARGUMENT 

FU NCTIO 

NUMBERED  ARMY 

A 

ACADEMY 

ACD 

UNIT 

U 

US  SHIP 

USS 

W ING 

WG 
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Table  1 - Naae  cf  Stop  Word  Table 

(optional) 

Table  2 - Name  cf  Eictionary 

(opt ional) 

Sub  1 - Name  of  User  Scan  Routine 

(optional) 

TEXT  Hyphen  Cpticn 

Default  is  TRXT 

DROP 
RETAI N 
SEPARATE 

TEXT  - Always  retain  as  part  of  text  value. 

DROP  - Always  drop  from  value.  Superfluous  if  (1) 

text  characters  immediately  precede  and  fellow 
hyphen  or  (2)  immediately  preceded  by  a text 
character  and  followed  by  one  or  more  blanks 
and  a text  character.  It  neither  cf  these 
cases  apply,  hyphen  is  treated  as  a word 
separator. 

RETAIN  - Same  rules  that  apply  to  DROP,  except  that 

when  the  hyphen  is  net  a word  separator  it  is 
kept  in  the  value  as  a text  character. 

SEPARATE  - Hyphen  is  always  treated  as  a word  separator. 

The  delete  operation  requires  only  the  first  three  operands 
- IN  CEX,  the  field  name,  and  the  action  keyword,  DELETE. 
Pot  a secondary  indexed  field,  the  add  operation  requires 
only  the  first  two  operands  --  INDEX  and  the  field  name 
but  may  optionally  provide  for  a conversion  and/or  analyzer 
subroutine  or  table.  In  this  case,  the  action  parameter  ADD 
must  be  present. 

If  only  one  subroutine  or  table  is  designated,  its 
function  - as  a conversion  subroutine  or  as  an  analyzer 
subroutine  - will  be  determined  £ com  the  parameters  that  are 
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specified  in  the  SUE/TAE  statement  defining  the  subroutine. 
If  both  parameters  are  present,  the  first  must  be  the 
conversion  subroutine,  and  the  second  must  be  ♦:he  analyzer 
subroutine.  An  analyzer  subroutine  or  table  may  not  be  used 
as  a conversion  routine,  and  a conversion  subroutine  or 
table  may  not  be  used  as  an  analyzer  subroutine  in  the  same 
Index  Specification  run. 

For  a keyword  indexed  field,  the  action  parameter 
KEYWORD  must  he  present  after  the  ADD  parameter  in  order  to 
differentiate  the  two  types  of  indexed  fields.  Any 
combination  of  stop  word  table,  dictionary  scan  routine  or 
hyphen  option  may  be  specified  in  any  order. 

Example  of  an  Add  Index  Action; 

INDEX  MEQFT  ADD  CONSUE 

Example  of  a Delete  Index  Action: 

INDEX  CNTRY  DELETE 


11.2  UTNDXSFC  Output 

DTNDXSPC  builds  and  inserts  Index  Descriptor  Records 
into  the  data  file  fcr  indexes  added  and  deletes  Index 
Descriptor  Records  for  indexes  deleted.  It  then  calls  Index 
Maintenance  to  either  generate  or  update  the  Index  Data  Set. 
UTNDXSPC  also  lists  a summary  of  actions  performed  plus  any 
error  conditiccs  encountered. 


11.3  UTNDXSPC  Job  Setup 

The  following  JCL  cards  are  used  to  invoke  the  cataloged 
procedure  XSP  which  will  either  generate  or  update  a disk- 
resident  Index  Data  Set  based  on  the  ISAM  or  SAM  data  file. 

//JObNAMF  JCE  (Standard  Parameters) 

• //STEPNAME  EXEC  XSP  , PARH=GE  N , I S.\  H=  f i le  name  , 

#//  VISAM= •SER=xxxxxx' , 

//  XVOL  = * SER  = yyyyyy 
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// 

// 

// 

// 

// 

/* 

where : 


#PAK  t'=GEN  - 


filenaae  - 


XXXX  XX 


yyyyyy 


aaaa 


zzzz 


nnn 


indxnaae  - 


/CISE=  (aaaa)  , 

ELKSIZE=zzzz, 

NBRBLK=nnn, 

XINDZX=indxnaaiG, 

LAB=bb,DEN=c,  V£MOUT=  •SER=dddddd'  ,SAnCUT=sainnaae 


Requited  cnly  when  creating  an  Index  Data  Set 
from  a file  already  containing  Index  Descriptor 
records  in  the  FFT. 

Name  cf  ISAM  or  SAM  data  file. 

Vclume  serial  number  of  the  disk-resident  ISAM 
data  file  or  tape-resident  SAM  data  file. 

Volume  serial  number  of  the  disk-resident 
Index  Data  Set 

Required  only  when  generating  a new  Index  Data 
Set 

Blocksize,  needed  only  when  generating  a new 
Index  Data  Set  and  overriding  the  default 
size.  Blocksize  must  be  between  560  and  1020 
bytes. 

Number  of  blocks,  needed  only  when  generating 
a new  Index  Data  Set  and  overriding  the 
default  size.  A minimum  of  50  blocks  must  be 
allocated . 

Name  of  Index  Data  Set.  It  must  be  the  same 
as  the  SAM  or  ISAM  operand.  The  name  will  be 
suffixed  with  an  X by  the  procedure. 
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The  following  parameterr.  are  required 

processing  a SAW  data  base: 

cnly 

bb 

- Label  processing 

c 

- Tape  processing 

dddddd 

- Volume  serial  number  of  the  output  SAM 

file 

samna  me 

- Name  of  output  SAM  data  file, 

same  as  input  file.) 

(Cmi t ted 

when 

date! 

if 
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# Sect  ion  16 

Format  Definition  Translator  Utility  (uTOnE) 


UTODE  is  used  tc  place  format  definitions  on  a user 
library.  A format  definition  gives  a description  of  a CRT 
display  format  and  the  Input  (lessage  Queue  records  to  be 
created  from  data  entered  on  the  ^display.  Before  a user  can 
call  for  the  display  format  at  a CRT  terminal,  the  format 
definition  must  reside  on  the  user  library.  UTODE  creates 
siteleton  and  IMQ  table  control  blocks  from  the  format 
definition  source  statements  and  writes  the  control  blocks 
into  the  user  library  using  the  display  format  name  as  the 
■ember  name. 


16.1  Input 

Input  to  UTODE  will  consist  cf  one  or  more  format 
definitions.  The  format  definition  source  statements  are 
described  in  Section  6 (FORMATTER)  of  the  Terminal 
Processing  Users  Manual.  The  input  source  statements  may  be 
in  punched  cards  or  in  card  image  records  stored  in  a 
partitioned  data  set. 


16.2  Job  Setup 

The  following  JCL  statements  illustrate  the  deck  setup 
used  to  execute  UTODE.  In  the  first  setup,  the  input 
definition  source  statements  are  in  punched  cards. 

//AA  EXEC  XUTODE,LIB=TEST360,VLIB='SSR=MYPACK' 

//SYSIN  DC  * 

Definition  source  statement  cards. 

The  following  JCL  would  be  used  if  the  input  were  card 
image  records  stored  in  a library. 
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//KB  Ey.'SC  XUTODE  ,LIB=TEST  ^60,  VLI  B=' SSP.  = M YPACK  • 

//SYSIN  DD  DSi;  = KYLIB  (FORMAT1 ) , VCL  = SSR=(1YPACK2  , 

//  DISP=  (SHR,KEEP)  ,UNIT  = 2314, 

//  DCB=  <FECFM=FM,LRECL  = BO  ,BLK3IZE=8C0 ) 

/* 
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This  volume  is  divided  into  the  following  sections; 


a . 


b. 


c. 


# d. 


f. 


TABGEN  - Discusses  the  user  conversion 
generator  function 


table 


SUB  IDS  - Discusses  the  user  conversion  subroutine 
leader  function 


Data  Conversion  - Discusses  the  data  base 
conversion  function  which  converts  a 1<<10  FFS  data 
base  tc  an  equivalent  NIPS  360  FFS  data  base 


File  Load/Dnload  - Provides  the  Job  Control 
Language  to  transfer  files  to  and  from  the 
Sequential  Access  Method  and  the  Indexed  Sequential 
Access  Method  or  the  Virtual  Storage  Access  Method. 


UTQFTQDF  - Discusses  the  creation  of  a NIPS  36C  FFS 
data  file  fre*  the  answer  file  (QPT/QEF)  produced 
by  the  retrieval  processor  (RASP) 


UTSUECHK  - 
function 


Discusses  the  user  subroutine  checkout 


OTDMPLIB 
names  of 
residing 


- Discusses  the  capability  of  printing  the 
reports  and/or  logic  statements  currently 
on  the  data  file 
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whe  re 


aaaaaaa 

= 

NIPS 

tbbbbb 

d is  k 

ccccc 

= 

1410 

dddddd 

= 

tape 

eeeeeep 

= 

NIPS 

f fffff 

= 

tape 

360  F*'S  ISAM  data 
serial  number  fci 
FFS  tape  data  base 
serial  number  for 
360  FFS  tape  data 
serial  number  for 


base  name  on  disk 
the  ISAM  data  base 
name 

the  1410  data  base 
base  name 

the  360  data  base. 


4.1.2  Procedure  :(1410CON 

This  procedure  will  convert  a NIPS  360  FFS  data  base  to 
a 1410  FFS  data  base.  The  NIPS  360  FFS  data  base  is  assumed 
to  bo  on  a 2314  disk  pack  and  the  converted  data  base  is 
written  on  a seven-track  tape  with  nonstandard  labels. 
Using  symbolic  parameters  for  this  procedure,  one  would  use 
the  following  JCL: 

//J05NAME  JCB  (standard  parameters) 

//  EX5C  Xl41CC0N,ISAM=aaaaaaa,VISAM  = 'SZR=btbbfcb  »,  X 

//  SAM=eeeee  , VSAM  = * SFF=ff  f f ff  • 

//SYS  IN  DD  ♦ 

(141C  FFS  FFT  cbject  deck) 


/* 

whe  re 


aaaaaaa 

= NIPS 

360  FFS 

ISAM 

data 

base  name 

c r.  disk 

bbbbbb 

= disk 

serial 

number 

for 

the  ISAM 

data  base 

eeeee 

= dat  a 

base  name  for 

the 

1410  FFS 

tape 

fffff f 

= tapo 

serial 

number 

for 

the  1410 

data  base. 
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overflow,  independert  overflow,  delete  option  and  feedback 
reorganization  criteria.  * 

* The  procedure  XSTCIS  is  used  to  tuild  a N IP  £ 36C  FF3 

ISAM  or  VSAM  data  base  from  a NIPS  360  FFS  SAM  data  base. 
It  is  assumed  that  the  existing  NIPS  SAM  data  base  resides 
on  a nine-track  tape,  and  that  the  ISAM  data  base  will 
reside  on  a 2314  disk  pack  with  a disposition  of  KEEP.  If 
output  is  tc  be  a VSAM  data  base,  it  must  have  been 
previously  defined  via  the  VSAM  service  routine  IDCAMS  and 
cataloged  on  a NIPS  user  catalog.  Using  symbolic  parameters 
for  this  procedure,  one  would  use  the  following  JCL: 


i 


//JOBNAME  JCB  (standard  parameters) 

//  EXEC  XSTOIS, IS AM=aaaaaaa,  VISAH  = ' SER  = bbbbbb' , X 

//  PRIME=cc, INDEX  = d, SAM^eeeeeee , VS  A M= • SE R= f f f f f f ' , 

//  PARI*= 'gggggg' 

/* 


whe  re : 


aaaaaaa 
b tbbbbb 
cc 

d 

eeeeee  ee 
f fffff 

i gggggg 


name  used  for  the  new  ISAM  data  base 
disk  serial  number  fcr  the  new  ISAM  data  base 
number  of  cylinders  cf  prime  space  for  the  new 
ISAM  data  base 

size  cf  index  needed  fcr  the  new  ISAM  data  base 
name  of  the  existing  SAM  data  base 
serial  number  of  the  tape  that  contains  the 
existing  SAM  data  base. 

parameter  cption  fcr  data  record  transformation 
(COMPRESS,  COMPACT,  EXPAND  or  both  COMPRESS  and 
COMPACT  separated  by  a comma)  or,  for  SAM 
to  VSAM,  replace  the  ISAM  parameter  with; 


VSCAT=aaaaaaaa, VSDSN=bhhbbbbt,  NON V£M= 'DUMH Y , • 


where: 

aaaaaaaa  = name  of  the  NIPS  user  catalog 
# bbbbbbbb  = name  of  the  VSAM  data  base  to 

be  loaded. 
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if  the  jet  was  successful,  or  a USER  0200  ABEND  if  the  job 
was  unsuccessful. 


»5.2  ISAM  or  VSAM  to  SAM  Utility  - UTBIDSAM 

•^his  utility  will  build  a SAM  data  base  from  either  an 
ISAM,  a VSAM  cr  another  SAM  data  base.  Under  control  of  the 
FARM  on  the  EXFC  card,  i''-  can  optionally  build  the  output 
SAM  data  base  in  the  compressed  and/or  compacted  form. 
Also,  prior  to  termination  of  the  utility,  it  will  print 
statistics  that  are  beneficial  for  the  user/an  al  yst. 

The  first  line  of  statistics  printed  gives  the  file 
name,  volume  serial  number,  date,  time,  and  page  number. 
Then  informaticn  is  printed  ccncetning  the  sets. 


5.3  Compressicn  and  Ccmpaction  of  Data  Records 

Compression  and  compaction  provide  a means  for  the 
reduction  of  intermediate  storage  reguirements  for  data 
without  altering  the  integrity  cf  the  data.  This  data 
reduction  scheme  is  particularly  suited  to  data  files  that 
contain  strings  of  identical  characters  or  a large  guantity 
of  alphabetic  data. 

A string  of  identical  characters  is  compressed  by 
translating  it  to  two  bytes.  The  first  byte  is  a control 
byte  which  indicates  that  compression  has  been  applied  and 
gives  a count  cf  the  number  of  identical  consecutive  bytes 
that  were  in  the  original  string.  The  secend  byte  is 
identical  to  those  in  the  original  string. 

A string  of  alphabetic  characters  is  compacted  by 
translating  it  to  a control  byte  followed  by  a string  of 
coded  characters.  The  ccntrol  byte  indicates  that 
compaction  has  been  applied 'and  gives  a count  of  the  coded 
characters.  Each  ceded  character  represents  a combination 
of  two  adjacent  alphabetic  characters. 

There  are  seven  columns  of  information  displayed,  with 
headings,  as  follows: 
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d. 


SIZE  If  a variable  field  is  specified,  the  ain- 

(BYTIS)  iaua  and  saxiaua  size  will  net  be  the  same. 


NOHBER  OF  These  two  coluans  reflect  the  ainiauni  and 


SUBSETS 
PER  DATA 
P ECORD 

HINIHUn 

HAXIHUH 


aaxiaua  nuaber  of  subsets  within  a periodic 
for  the  total  record.  The  fixed  set  would  be 
1 for  xiniauB  and  saxiaua.  The  absolute 
ainiaum  for  periodics  would  be  ;0  and  the 
aaxiaua,  any  variable  nuaber. 


e. 


TOTAL 

NUMBER 

OF 

SUBS  ETS 


The  total  nuaber  of  subsets  in  each  periodic 
set  for  the  entire  file  is  printed  here. 

The  nuaber  printed  for  the  fixed  set  is  the 
total  nuaber  of  data  records  in  the  file. 


f.  SIZE  OF  This  field  shows  the  aaxlmua  size  in  bytes 

LARGEST  cf  the  indicated  set  for  any  record  in  the 

SET  file. 


For  the  ISAM  file,  the  above-aentioned  statistics  are 
printed  along  with  infer  aation  cn  the  organization  of  the 
ISAM  file. 


The  nuaber  cf  PRIME,  OVERFLOW,  DELETE,  and  PAD  records 
is  calculated  and  printed.  Alsc  inforaation  from  the  ESCB 
is  printed.  The  DSCB  inforaation  concerns  the  INDEX,  PRIME, 
and  OVERFLOW  cylinder/track  allocation  and  usage.  The 
column  headings  are  "CYL/TRACKS  ALLOCATED,"  "TRACKS 
UTILIZED,"  and  "PERCENT  TRACKS  UTILIZED."  The  number  of 
tracks  in  each  cylinder  overflow  area  is  also  provided. 
With  this  information  the  user  can  calculate  the  aacunt  of 
space  needed  for  his  job.  This  alleviates  unnecessary  pad 
records  that  are  added  if  any  prime  area  remains. 

The  JCI  DC  cards  used  are: 

//DATAFILE  DD  parameters  defining  existing  ISAM  data  file 
i//VSHFILE  DD  parameters  define  existing  VSAN  data  file 
//SAMFILE  DD  paraaeters  defining  existing  SAM  data  file 
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vhe  re : 

aaaaaa 

tfcbbbb 

eeeeee 

ftffff 


nane  of  the  existing  SAM  data  file 

serial  nusber  of  the  volume  where  the  SAM 
data  file  resides 

name  used  for  the  new  SAM  data  file 
serial  number  for  the  new  SAM  data  file 


i Ug'jggg  = parameter  option  for  data  record  transformati 

(COMPRESS,  COMPACT,  EXPAND  or  both  COMPRESS  and 
CCHPACT  separated  by  a comma)  or,  for  VSAM 
to  SAM,  replace  the  ISAM  parameters  with: 

VSCAl=aaaaaaaa  ,VSDSN=bbbbbbbb 
where : 

aaaaaaaa  = nane  of  NIPS  user  catalog 
* tfcbbbbbb  = name  of  exisitng  VSAM  data  file. 

i Keywords  in  the  PABN  are  used  to  designate  the  form  of 
the  output  SAM  data  base  irrespective  of  the  form  of  the 
input  ISAM,  SAM  or  VSAM  data  base.  The  keywords  for  the 
PARM  and  their  implications  are  the  sane  as  those  for  the 
SAM  to  ISAM  Utility. 

Upon  successful  completion  of  UIBLDSAM,  the  user  will 
receive  the  message: 

•NIPS  SAM  DATA  FILE  HAS  BEEN  SUCCESSFULLY  CREATED*. 
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cards  are  required  for  each  argument  - use  blank  cards  as 
filler  if  necessary). 


7.3  Job  Setup 

The  following  statements  illustrate  the  job  setup  used 
to  execute  the  XSOBCHK  prccedure: 

//  EXEC  XSUBCHK,LIB=TESTEP 

//SUBCHK. SYSIN  DE  ♦ 

(control  card  defining  input  as  described  in  7.1) 

data  card  (s) 

/♦ 

The  LIB  symbclic  parameter  defines  the  partitioned  data  set 
where  the  subroutine's  executable  load  module  is  stored. 
The  library  need  not  be  a NIPS  file  library,  tut  it  should 
have  the  same  DCB  attributes. 

Sample  Control  Card 

MTSOB  C99 

Sample  data  cards  in  the  above  case 

Col  00 


123456789CAQFTe6789ABCB  123796 

709056789  3BCBDEFGHQ 

1379654321EDLC86789EFCC  569324 

843297684 3 AFQDETGHQ 
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i or 

n 'T'D  n;  D7,  T t 


3 "he  atili^y  program  UTinPLIB  allows  the  aser/analyst  <-o 
prin+  tho  names  of  reports  anci/nr  logic  statements 
S'-’SC'cta*'*'!  Vii*’h  a NTP*-  fiio,  thii  oMtoi’^-  from 

'‘hi'  ’I  t 1 ■'  t V S A enr-  jp  aV  +-oaiis+’in'^  j 

1 ? V P e ’ S e '3  ’T  I”'  ’ a 1 ^ r C e PS  y p ♦ h •*  B / S ^ Tn  a o S e ' I’O  n *•  ' a l. 

i t;  c Mo1-Ko(1  (/SA^)  <•  i'  V’,r^Pa1  SI  A. 1.3  i3.'f-.3<p-^  «'  h o '* 

^nr"i 


B . ] I n [ ij  t 

''npM^-  for  trie  cataloged  procedure  XDflFLTB  cons3sts  of 
the  user’s  file  (SAM,  ISAM  or  ^^SAM)  and  a single  ccntrol 
•-,•,••11  "iie  r-Terni  --ard  ’p  in  » e-jyra  f^rinAe  jr\  eiigp  mijc:*- 
heri-ir  jn  caro  roluiMP  1 ar  d pnrAn“te'’=  m'lS'"  ne  se^  A-iv,;  .i-i 
or'..': -.  . The  control  card  i .s  ’■o  jo  prepared  a.s  ^ollovs: 

poTtig^  pppoPT,xxyxryy 

whor  ' '''vvvYxx  will  contain  one  o*  *•  he  following  j ar  e r '■+•  p rr  • 

All  - provides  a listing  of  all  lepcrt 

names  and  aM  logic  sh^  epin\ en ■*■  e 

TTSl'  - provides  .’  list  of  all  r«'p'~rt-  ram-s 

( Sep./ ^ ID)  - pr ov  i d es  a .’'ting  cf  all  loci,  s + a i ^ • 

nie>nf  HP,  qiop  f r r <-ho  repoT*"  ID  rpecif'e"^ 


B.2JofcSetup  I 

1 he  f y'lcwing  statements  will  issist  to  illustrate  th  i i u j 

r-f,  »■  1.  • ye'nuijf.fi  *-o  execute  the  yntttTR  procedure:  ! 

! 
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//  EXEC  XDMPLXB,ISA«=TESTFR 

//UTCMP.SYSIM  CD  ♦ 

PRINT, FEPOET, ALL 

/* 

The  preceding  exaaple  will  list  all  report  anc  statement 
names  on  a cataloged  ISAH  data  set  named  TESTER. 


#//  EXEC  XDHPLIB,VSCAT='NIPS. CAT', ISAB='VSAN. TESTER' 
//UTEBP.  PAT  AFILE  DD  AnP='AHOPG' 

//OTDMP.SYSIN  DD  * 

PRINT, REPORT,  ALL 

/* 

# The  preceding  example  will  list  all  report  and 

statement  rases  on  the  VSAM  file  VSAH. TESTER  cataloged  on 
NIPS. CAT. 

//  EXEC  XDHPLIB,ISAE=TESTEP,VISAH  = 'SEP=FFSLIB' 

//OTEBP.S  YSIN  DD  * 

PRINT, REPORT, REPTA 

/* 

This  example  will  list  associated  logic  statement  names 
for  a report  entitled  REPTA  included  in  the  uncataloged  ISAM 
data  set  TESTER  residing  cn  a 2314  volume  labeled  FFSLIE. 

//  EXEC  XDflPLlB,SAB  = TESTER,VSAM=' SER=Nl2ia5' 

//DTEKP.S  YSIN  DD  ♦ 

PRINT, REPORT, LIST 

/* 

The  preceding  example  provides  a listing  cf  all  report 
names  contained  within  the  data  set  TESTER  which  resides  on 
a nine-track,  800  bpi  tape  with  the  volume  serial  number  of 
N12345. 

The  XDHPIIB  procedure  uay  be  executed  in  a separate  job 
or  as  a step  of,  for  example,  an  FH  update.  It  is  to  be 
notad  that  all  routines  used  in  conjunction  with  the 
execution  of  this  procedure  reside  cn  FPS.JOBLIB. 
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i-=crj.or.  -5 
o T CL  AS  S 


•»  rh-?  prcgCdiD  UTCLASS  pro'/xd-^s  thfi  'jsec  i<*<-h  t.if? 
capability  cf  chanqing  the  classification  of  a NIPS  36C  F?S 
TSA^I,  SA."*  ot  VSAM  file.  A single  card  is  required  which 
~ilL  ccbtain  uni/  rne  ne*  class  j.£  r:at  ion  of  tne  fixe. 


> • i JL  j-  U C 

: .1  ' progiain  UTCLAJS  requires  a single  input  card 
■ - i.  l-r '\ ; the  new  cl  ass  i ticat  xon  3t  the  nata  tile.  The 

'.a.  ' is  tree  format  and  the  new  c la  ssii  ica  tion  will  ra  left- 
j ,..t  i .^'1  with  trailing  blanics,  ic  required,  when  wt.tte.i 
out  to  tiie  file.  Ihe  length  cf  tae  classification  liaid  is 
hi  K’ters  mid  truncation  will  be  performed  to  the  rtylit. 

.iiange  lass  i * tea  - lo  n ot  - le  ; .le  to  a;  cS 

.1  > - L i.  ..j  . i ic  a 1 1 cu  , the  input  cur-i  «-Jst  (.rontaia  a ■.  least  oii‘> 
bii  ir;  y;ic  lo.sed  in  apostrop  aes.  ’^uis  is  '■he  only  case  in 
It  .1  pus op  he  which  is  euteien  on  tlie  iiip,ut  card  does 
;iuu  o>'i;oine  part  of  tiie  actual  fixe  ci  assi  f icat  ihn . 


1 0 11  *■  p j t 

iutpUi-s  a.  e prouucen  oy  a successtu  . run  or  '.i..; 

iJ  . / 1 < j.  . ; . I . 

. i ti*.-'  upluted  data  tii  ‘ containing  :ne  new 

cl assi f icat ion  . 

i.  A iiotiiig  xii  the  printer  xfuicatinq  succerisrux  oi 

unsuccessful  updating  and  ♦he  new  classification  if 
s uccessf  ul  , 


X 
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//CLASS. SYSIN  DC  * 

(user- suppl iftd  card  ccntaining  new  classification) 

/* 

i The  preceding  exasple  will  change  the  classification  of 
the  VSAH  file,  VSAH. TESTER,  cataloged  on  NIPS. CAT. 
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9.3  Job  Setup 

The  following  stateoerts  illustrate  the  leek  setup  used 
to  execute  the  UTCLASS  procedure. 

//  EXEC  XCLASS,ISAK=TESTER, 

//  VISAM='SER=FFSLIE' 

//CLASS. SYSIN  DD  * 

(User-supplied  card  containing  new 
classificat  ion) 


/* 

The  preceding  examples  will  charge  the  classification  on 
an  uncataloged  ISAM  file, 

//  EXEC  XCLASS,SA«=TESTER,VSH0UT=*SER=TETVOL' , 

//  SAM001= 

(User -supplied  card  containing  new 
classification) 

/♦ 

The  preceding  example  will  change  the  classification  of 
a cataloged  SAM  file  on  tape. 

//  EXEC  XCLA SS,SAM=TESTER, 

//  USAH=2314,7SAM=' SER=FFSLIB' 

//CLASS. SYSIN  DD  * 

(User-supplied  card  containing  new 
classi f icat  ion) 


/* 

The  preceding  example  will  change  the  classification  on 
an  uncataloged  SAM  file  on  disk. 


#//  EXEC  XCLASS, VSCAT=' NIPS. CAT' , ISAM=*V£AM. TESTER • 
//CLASS. DATAFILE  DO  AMF='AHOFG' 
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f CLI  £iv;  E L A N GLI  AG  t J 0 R A 0.  r 


.lource  prcyraois  ter  Nii  S co:flpL  iien  ts  may  be  rtorej  on  a 
libra  rv  *-a  facilitate  hnus^k  eepiiiq  and  program  maintenance. 
■’ air.  - ainin  g a librar.y  will  ensure  'rhat  a ?5inqle.  current 

of  source  proijram  iS  aiwavs  ava.,lat':e-  'he 

' .'.;rv-e  i'Log  ;a:i!  i.iorai.  y te  upoated  nv  catch  lots,  <■  ’ ov 

.1.0  r.bi?  companeiit  it  or-lin-  termia  Is  .i.ia  the  M : I'.s  ’ 

como'Ui'iit  aie  a7c:Lacie.  HDC”  ca  n.;  ti ' it.  i es  ar*-  if 

i' '■  cf  the  NIPS  I'ser  (lamiais,  '’erfinai  Froces.tir.g 

(■  ■^)  . 


10.  ' source  ::,iDtaLies 

■ .c  •yp'i^s  c.  iiLraries  can  b"  utilizel  tor  s t-'.r e. 
t'c'f.  1-6  s a_e  d iTrect-acre.ss  pa.ritioatd  la -a  .€:f.  1 r - 

r.  I at  xior-ii.y  is  110111..^]^  .re.,  to  rtora 

' ill-. yes.  T.iis  iitrary  is  siritar  to  a Prcceiaie  ci 
i-Iac:  c Libr.ary  and  has  fixed  lenjth,  RO-character  records, 
norin-ili,  oiocked  to  an  effii-ien:  tiocksize  which  is  a 
.uui<  i pie  c f ec. 

he  second  type  of  librar-/  i.s  the  File  Library.  ?hrs 
'.i.htcirv  . aS  recoi  .is  of  undefined  lergt.h  and  is  notin' 'v  i;.<^e(i 
to  ;•  ov  tiic  coGj-iled,  ex'culaoie  NIPS  u.sp  r p’^yj 

. V ^ V:  i r , Ri"s,  etc.).  Source  ptoyrams  will  >6  sicre-i 
- Ill  ii  ROC-chaiact m t deck.  3,  rontatniru,  •• -.r 

•.i\.a,  ■ '-..ch,  'IS  'itilities  laav  ao.  he  used  to  mou..t/  . i .u . .; 

j.  his  type  of  library,  but  ‘-(IPS  components  may  .s 

■ii-scusse  1 te  lew  . 

Each  source  program  member  stored  on  a library  hj  a MLS 
language  component  or  utility  will  contain  an  incicatcr  as 
-o  v.'ich  hiPS  language  coipci.ei.  t (PASF,  FP",  etc.)  - .s 

.nveived.  This  will  enable  a terminal  user  to  scan  a 
.thi.'j.v  tor  RIT.s,  Icgic  sta  to  le  nt  s , etc. 
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Section  11 

INDEX  SPECIFIER 
PJTNDXSPC) 


The  Index  Specification  utility  allows  a user  to  specify 
indexing  information  for  a data  file  without  running  a File 
Structure  or  File  Maintenance  job.  The  user  can  add  and 
delete  indexes  in  the  same  run.  Pci  each  index  added,  all 
information  necessary  to  make  that  index  operational  is 
generated  and  placed  in  the  Index  Data  Set. 

Any  fixed-length  field  defined  in  the  file  may  be 
specified  as  a secondary  index.  Any  variable  field, 
variable  set  or  fixed-length  alpha  field  defined  in  the  file 
may  be  specified  as  a keyword  index.  A fixed-length  field 
may  not  be  specified  as  both  a secondary  and  keyword  index. 

# UTNDXSPC  acts  as  the  driver  to  perform  the  functions  of 
calling  Index  Specification  to  insert  or  delete  Index 
Descriptor  Records  in  the  data  file,  and  of  executing  Index 
Maintenance  to  correlate  the  Index  Descriptor  Records  in  the 
data  file  with  the  Index  Control  Records  in  the  Index  Data 
set  and  to  update  the  latter  accordingly.  UTNDXSEC  operates 
on  an  ISAM,  SAM  or  VSAM  data  file. 


11.1  OTHDXSPC  Input 

UTNDXSPC  accepts  SOB/lAB  and  INDEX  statements  as  input. 
These  statements  must  be  submitted  through  the  SYSIN  device. 
Further  discussion  of  index  Specification  may  be  found  in 
Volume  II,  File  Structuring. 


1 1. 1.  1 SOE/TAB  Card 

A SOB/TAE  card  is  used  to  describe  a subroutine  cr  table 
to  be  used  by  secondary  indexing.  A subroutine  or  table  may 
be  a conversion  routine,  to  convert  data  from  an  internal 
data  file  format  tc  a separate  index  format.  On  the  other 
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|! 


\anJ,  a sutroutinT  or  tabj-P  niay  n aii  anaiyz«r 
' L.', .-aac;  c analyze  IhP  prianett.  r Ir.'t  cr. 
croiator  to  aetcrmine  incer  usaqe  end  1:107102  a 
va*...f  f for  index  ^uali.ticat  lor « 


1C  urine, 
r U ni.  1 ' • h 
1 1 £.  t or. 


l 01  ? Re  word  indexed  licic,  a ‘UDroutine  ci  tapa.e 

ietir'.es  options  that  direct  the  seiecticn  cf  keyword  valueii. 
It  may  designate  a stop  word  table  which  is  a list  of 
viel-^vant  (noise)  words,  a dictionary  which  is  a list  of 
::  M ncii-Li  feral  keyworas,  or  a user  scan  routine,  ih'.cfc  is 
j s -ibrc  It  me  provicta  ty  the  user  to  pioc:e>s  thi  KfVwi'- 
:t  in  • IP  1 ns . 


SUB/TAB  card  must  oe  submitted  tor  eacti  suirouTii.  . 
rofotreri  no  by  the  INDEX  stateaents.  A subroutine  or  table 
Q£i  i -r  iofint'd  ccr  cne  function  oju  y in  an  Ii.  le . 
.•■>0-?  v,  ion  '.uri,  and  eacii  unique  suoroir  in”  or  tai.xt  Oc  1.  • 
atay  i:*:  s.iumitted  only  once  per  lUi. . 

. 1 :![3/”Ah  statements  must  appear  first  in  the  i gui. 

I',  bstore  il.e  INDEX  st  at  eme  1 rs 

' >1'=-  'Jh'ti/TAD  oiatement  is  f t - t c t aa  t . The  operands  luus’ 
ne  m •'iKier,  each  separated  froa  the  others  by  at  lea-t^t  one 
-j1;.  n , ,*  periou  is  used  ui+er  the  xust  entiy  to  signixy  tiie 

enrt  ..  f the  statement. 

hean  in  tj 


Statement  id  10  airier;  may  be  an  ^ -;ia 
these. 


Name  of  subroutine  or  table.  This  name 
must  follow  "he  conventions  for  system 
names  as  described  in  Volume  i. 
Introduction  to  lile  Concepts. 


rii. 

IT 

' ' "'‘iS  B 

IB 

:.:r. 

1 utj  n ri” 
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Table  1 
(opti onal ) 

Table  2 
(opt  ional) 

Sub  1 
(optional) 

2121 

DROP 

RETAIN 

SEPARATE 

TEXT 

DROP 


RETAIN 


SEPARATE  - 


Name  cf  Step  Word  Table 

Name  cf  Dictionary 

Name  of  User  Scan  Routine 

Hyphen  Cpticn 
Default  is  TEXT 


Always  retain  as  part  of  text  value. 

Always  drop  from  value.  Superfluous  if  (1) 
text  characters  immediately  precede  and  follow 
hyphen  or  (2)  immediately  preceded  by  a text 
character  and  fallowed  by  one  or  more  blanks 
and  a text  character.  If  neither  cf  these 
cases  apply,  hyphen  is  treated  as  a word 
separator. 

Same  rules  that  apply  to  DROP,  eicept  that 
when  the  hyphen  is  net  a word  separator  it  is 
kept  in  the  value  as  a text  character. 

Hyphen  is  always  treated  as  a word  separator. 


The  delete  operaticn  requires  cnly  the  first  three  operands 
- INDEX,  the  field  name,  and  the  action  keyword,  DELETE. 
For  a secondary  indexed  field,  the  add  operaticn  requires 
only  the  first  two  operands  — INIEX  and  the  field  name 
but  may  optionally  provide  for  a cenversion  and/or  analyzer 
subroutine  or  table.  In  this  case,  the  action  parameter  ADD 
must  be  present. 

If  only  one?  subroutine  or  table  is  desiqnated,  its 
function  * as  a conversion  subroutine  or  as  an  analyzer 
subroutine  - will  be  determined  fret  the  parameters  that  are 
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sp“cifiei  in  th<=>  SUE/TAE  statement  defining  the  subroutine. 
If  both  parameters  ar^  present,  the  first  must  be  t 
conv<^rsion  subroutine,  and  the  second  must  be  the  analyzer 
subroutine.  An  analyzer  subroutine  or  table  may  not  be  use-’ 
as  a conversion  routine,  and  a conversion  subroutine  or 
tabl‘d  may  not  be  used  as  an  analyzer  subroutine  in  the  same 
Index  Specification  run. 

"or  a keyword  indexed  field,  the  action  parameter 
K2YW0PD  must  tc  present  after  th®  ADD  parameter  in  order  to 
differentiate  the  two  types  of  indexed  fields.  Any 
<-oui  b mat  lo  n of  stop  word  table,  dictionary  scan  routine  or 
hyph'-'‘n  option  may  be  specified  in  any  order. 

'Example  of  an  Add  Ind°x  Action: 

INDEX  MSyPT  ADD  CONSUB 

Example  of  a Delete  Index  Action; 

INDEX  CNTPY  EELFTE 


11.2  UTNDXSi’C  Output 

UTNDXSPC  builds  and  inserts  Index  Descriptor  Pecords 
into  the  data  file  for  indexes  added  and  deletes  Index 
Descriptor  Records  for  indexes  deleted.  It  then  calls  Index 
fla i n •■enance  to  either  generate  or  update  the  Index  Data  Set. 
UTNDXSPC  also  lists  a summary  of  actions  performed  plus  an/ 
error  conditions  encountered. 


11.3  UTNDXSPC  dob  Setup 

« : ho  following  JCL  cards  are  used  to  invoke  the  cataloged 

procedure  XSF  which  will  either  generate  or  update  a disk- 
resident  Index  Data  Set  based  on  the  ISAM,  SAM  or  VSAB  data 
file. 

//JODKAME  JCB  (Standard  Parameters) 

//^-irpNAME  EXEC  XSP , P APB  =G  EN  , I S A B = f i le  name  , 

//  VISAH='SER=XXXXXX* , 
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// 

XVOL=*SEP=yyyy 

// 

XDISP=  (aaaa)  , 

// 

ELKS IZ E=zzzz, 

// 

NBRBLK=nnn, 

// 

XI NDEX  =i ndxnam 

»// 

VSCAI=ni peat. 

// 

LAB=bb,DEN=c,  V 

i//UTXSP.N  EWFILE 

DD  AMP  = *AMORG' 

/♦ 

w here  : 

yy  •» 

SMOOT='  SEF^dddddd*  , SA MO UT  = sd  nna 


P ARM = GEN 


#f  i l^»na  ae 

xxxzxx 


yyyyyy 


Required  only  when  creating  an  Index  Data  Set 
from  a file  already  containing  Index  Descriptor 
records  in  the  FFT. 

Name  of  ISAM,  SAM  or  VSAH  data  file. 

Vcluae  serial  number  cf  the  di sk- resident  ISAM 
data  file  or  ta  pe- resident  SAM  data  file. 

Volume  serial  nunter  of  the  disk-resident 
Index  Data  Set 


aaaa  - Required  only  when  generating  a new  Index  Data 

Set 


zzzz 


nnn 


indxname 


Elocksize,  needed  only  when  generating  a new 
Index  Data  Set  and  overriding  the  default 
size.  Blocksize  must  be  between  56C  and  1020 
bytes . 

Number  of  blocks,  needed  only  when  generating 
a new  Index  Data  Set  and  overriding  the 
default  size.  A aicimum  of  50  blocks  must  be 
allocated. 

Name  of  Index  Data  Set.  It  must  be  the  same 
as  the  SAM  or  ISAM  operand.  The  name  will  be 
suffixed  with  an  X by  the  procedure. 
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The  follcwing  parameter.^  ate  reguiced  only  when 


processing  a 

SAM  data  base; 

bh 

label  processing 

c 

Tape  processing 

dddddd 

Volume  serial  number  of  the  output  SAM  data 
f ile 

; n ri  a me 

Name  cf  output  SAM  data  file.  (Omitted  il 

same  as  input  file.) 

# The  follcwing  parameter  and  the  NFIMFILZ  DC  override 
3ta«->n)ent  are  used  only  when  processing  a VSAM  data  file; 

»nipcat  - Name  ct  the  NIPS  user  catalog  for 
the  VSftM  data  file. 
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Section  12 

Index  Transfer  (UTNDXTFR) 


An  Index  Data  Set  may  reside  cn  a d irect- access  device 
or  on  tape,  tut  only  the  disk- resident  medium  can  be  used  by 
any  MIPS  component.  Index  Transfer  (UTNDXTFP)  will  permit 
the  user  to  transfer  the  entire  data  set,  from  one  resident 
medium  to  the  other. 

The  primary  use  of  UTNDXTFR  is  tc  reorganize  the  disk-  i 

resident  indexes.  Initially,  a d isk- resident  Index  Data  Set 
is  packed  with  index  information.  As  the  indexes  are 

maintained,  gaps  or  unused  areas  may  occur  in  the  data  set 
as  records  are  deleted  and  others  are  added.  By  using 

UTNDXTFP,  the  user  can  transfer  the  disk- resident  data  (only 
the  valid  information  is  transferred)  to  tape,  anc  again 
from  tape  back  to  disk.  This  operation  condenses  the  data 
set.  The  tape  so  created  may  be  retained  as  a backup. 

In  the  disk  to  tape  mcde  of  operation,  a statistical 
printout  of  unigue  values  (for  secondary  indexed  fields)  and 
keywords  (for  keyword  indexed  fields)  and  their  cccurrences 
are  optionally  developed.  Binary  values  will  be  converted 

to  decimal  for  ease  of  reading.  However,  any  dictionary 

fields  using  conversion  subroutines  or  keyword  fields  having 
synonyms  in  the  dictionary,  will  be  printed  in  the  converted 
form,  just  as  they  appear  in  the  Index  Data  Set. 


12.1  UTNDXTFR  Input 

Two  cataloged  procedures  are  available  for  invoking  the 
UTNDXTFR  Utility.  XTRDISK  will  transfer  a disk -resident 
Index  Data  Set  to  a sequential  access  medium,  while  XTRTAPF 
will  reconstruct  an  Index  Data  Set  from  a previously 
unloaded  tape  version  of  the  disk  data  set. 
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12.2  IITNDXTFR  Output 

'ItNDXTFR  producps  an  Tndax  Data  Set  on  the  residence 
mediun’  indicated. 


12.3  tJTNDXTFR  Job  Setup 

The  following  JCL  cards  are  used  to  invoke  the  cataloged 
procedure  XTRDISK  which  will  unload  a d i sk -re siden t Index 
Data  Set  to  a seguential  access  mediun: 


//JODNAME  JOB 
//STSPKAME  EXEC 
// 

// 

// 

// 

#// 

#// 

#//X:’P.  DAT  AFIIE 

/♦ 


(Standard  Parameters) 

XTRDISK,  XFNAME^AAAAAAAA, 
XFVCL=  EBBBBB,XTNAME=CCCCCCCC, 
XTVOL=DDDDDD, 

STAT=YES,  (optional) 
ISAM=EEEEEEE, VISAH=FFFFFF 
VSCAT=XXXXXXXX  , 

SAM=GGGGr,G,  VSAn  = HHHHHH 
DD  AME=*AMORG' 


wher^: 


AAA  AAAAA 

DBBnnp 


Name  of  the  Index  Data  Set  (the  user  must 
supply  the  "X '•  suffix) 

Vclume  serial  ruirber  of  the  disk- resident 
Index  Data  Set 


cccccccc 


Name  of  the  unloaded  version  of  the  Index 
Data  set 


DDDDCP 


opt  renal 
pa  ra  ire  ter  s 

# EE P FREE 


Vclume  serial  number  of  the  sequential 
access  device  which  will  contain  the 
unloaded  Index  Cata  Set 

required  only  when  the  statics  option 
(STAT=YES)  is  chosen. 

Name  of  the  ISAM  or  VSAN  data  file 
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FFFFFP 

Volune  serial  nuaber  of  the  ISAM  data 
file 

GGGGGGG 

- 

Saae  of  the  SAM  data  file 

HHHHHHH 

- 

Vclume  serial  ruxber  of  the  SAM  data  file 

#xxxxxxx 

- 

Naae  of  the  NIPS  user  catalog  for  the 
VSAH  data  file. 

* The  DATAFIIE  DD  override  statenent  is  used  only  for 

processing  VSAN  data  files. 

The  following  JCL  cards  are  used  to  invoke  the  cataloged 
procedure  XTFTAPE  which  will  reconstruct  a disk- resident 
Index  Data  Set  froa  a previously  unloaded  sequential  version 
of  the  Index  Eata  Set: 

//JOB  NAME 

//STEPNAME 

// 

// 

JCE 

EXEC 

(Standard  Paraieters) 

XTR TAPE, XTNAHS=AAA AAAAA, 

XTVCL=BBBBEB,  XFN  AM  F=CCCCCCCC, 

XFVOL=DDDDDD 

where: 

AAA AAAAA 

- 

Naae  of  the  disk-resident  Index  Data  Set 
(user  aust  supply  the  "X"  suffix) 

BBBBBB 

- 

Vcluae  serial  ruaber  of  the  disk-resident 
Index  Data  Set 

CCCCCCCC 

- 

Naae  given  to  the  unloaded  version  cf  the 
Index  Data  Set 

DDDDDD 

- 

Voluae  serial  nuaber  of  the  device 

containing  the  unloaded  version  of  the 
Index  Data  Set 
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S^'ction  13 
nTFLDSCN 


UTFLDSCN  will  scan  the  NIPS  conponents  source  stateuents 
and  provide  the  user  with  the  ccunt  of  data  fields 
referenced  in  the  source  statements.  This  utility  is  useful 
in  helping  the  analyst  to  determire  the  activity  of  his  data 
fields.  This  will  assist  the  user  in  determining  which 
fields  are  candidates  for  index  fields  in  the  Seconda'-v 
Indexing  capability. 

The  utility  will  process  source  statements  pertaining  to 
a single  file  in  one  execution.  Multifile  PITs  and 
multifile  queries  will  be  accepted  as  input;  however,  only 
the  data  fields  of  the  input  data  file  will  be  processed. 
All  other  files  will  be  ignored.  In  order  tc  ccmpleteiy 
proc  -ns  multi-file  PITs  and  multifile  queries,  it  would  be 
necessary  to  include  the  source  statements  in  an  execution 
for  each  file  referenced. 

(ITFLDSCN  will  output  a listing  of  the  scurce  input 
statements  fcllcwed  by  a listing  cf  the  count  of  references 
for  the  data  fields  and  a summary  listing  of  data  field 
reference  court  for  each  batch  coipcnent.  A transaction 
record  will  also  be  output  for  each  data  field  referenced  in 
a sir, gla  source  input  statement. 


13.1  HTFICSCN  Input 

# Input  to  the  utility  will  consist  of  a NIPS  data  file  in 
SAM,  ISAM  or  VSAM  format,  a ccntrcl  card,  and  the  source 
inpu*-  statements  and/or  members  of  a partitioned  data  set. 

""he  format  cf  the  input  control  card  is  as  follows: 

./  SOURCE  COMP=XXXX,  tiAHE=SN  AI1E,I1  EM  EFP=MMAnF 

wh»re  ./  must  be  in  columns  1 and  2 followed  by  one  or 
hlan k s . 


4. 
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CCMP=XXXX  where  XXXX  may  be  FH,  RASP,  CP,  or  CUIP 
to  identify  the  component. 


NAME=SNAHE  where  SNAKE  is  the  name  of  the  source 

statement.  If  the  source  is  a logic  statement, 
the  name  must  be  the  report  name  anc  Iccic 
statement  names  enclosed  in  quotes.  If  the 
report  name  is  less  than  seven  characters,  it  must 
be  padded  with  blanks  tc  ^ven  characters. 


HEnBER^HNAHE  where  NNAHE  is  the  member  name  cf  the 
source  statement  on  a partitioned  data  set. 

If  this  operand  is  used,  a partitioned  data  set 
must  be  included  in  the  job  stream.  If  this 
operand  is  emitted,  the  source  statements  must 
follow  the  control  card  in  the  input  stream. 


13.2  UTFLDSCN  Output 

The  outputs  from  UTFLDSCN  are  as  follows: 

Source  Listing  - The  source  input  records  in  input 

order. 

Field  Listing  - This  output  will  consist  of  a header 

for  each  source  deck  indicating  file 
name,  component  name,  source  name,  and 
member  name,  if  any.  The  body  of  the 
listing  will  consist  of  only  those 
fields  referenced  and  the  count  of 
references.  This  will  follow  the 
source  listing  for  each  source  module. 
After  all  source  modules  have  been 
processed,  a summary  listing  will  be 
provided  containing  the  count  of  the 
field  references  per  component. 

Transaction-  . » The  transaction  data  set  will  be  50 

Data  Set  ’ characters  long  with  an  'S'  in  cclunn 

one  to  be  used  as  a logic  statement 
' name.  The  format  is  as  follcws: 


61 


CH-  3 


utility  Support  (UT  ) 


Colunn  1 
2-  8 
9-12 
13-25 
26-33 

3 6-36 
37-42 

4 3-48 
49-50 


CHARACTER  'S' 

FILE  NAME 

COMPONENT  NAME 

SOURCE  MODULE  NAME 

FIELD  NAME 

SET  NUMBER,  DECIMAL 

COUNT  OF  REFERENCES,  DECIMAL 

DATE  - MHDDIY 

UNUSED 


Parameters  may  fce  entered  in  the  FARM  field  on  the  EXKi. 
card  to  suppress  output.  They  are  as  follows: 

NS  - Suppress  printing  of  source  input 

NI  - Suppress  field  and  sumnary  listing 

NT  - Suppress  transaction  output. 


13.3  Jot  Setup 

4 Th?  utility  will  be  executed  by  a procedure,  XUTFSCAN. 
If  ♦■he  input  statements  are  members  of  a partitioned  data 
set,  the  data  set  must  be  included  in  the  job  stream.  The 
following  statements  illustrate  the  job  setup  used  to 
execute  the  XUTFSCAN  procedure  against  the  ISAM  data  file 
TEST360: 

//  EXFC  XUTFSCAN, ISAM=TEST 360, LIE=TEST360 
//SYSIN  DD  ♦ 

./  SOURCE  CCMP=  FE,  NAME=' TFSTO  A • , M EM  B ER  = TEST  A 
./  SOURCE  C0I!P=B  AS  E,  NAME=TEST0  1 
RASP  Query  Statements 

./  SOURCE  CCHE=OP,  liAME=TESTPFF 
OP  RIT  Statements 

./  SOURCE  COMP=QOIP, NAME=QTEST, HEMBBR=QTESTA 

/* 


X 


4 
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# The  following  JCL  could  be  used  to  execute  the 
procedure  against  the  VSAH  data  file  VSAH.T5ST360 : 

#//  EXEC  XUTFSCAN  ,ISAM=»VSAH.TEST360'  ,LrB=TEST360 
//  VSCA1=' NIPS. CAT* 

//OTFLDSCN.  DATAFILE  DD  AMP='AriOBG' 

//UTFLDSCN. S YSIN  DD  * 

(field  scan  control  sta teaents) 

/* 


XCTFSCAN 
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Section  14 
IITNDXK  AN 


UTNDXKAN  provides  the  user  vith  the  capability  to 
analyze  the  uotcls  in  fields  for  which  keyword  indexinc  is  to 
be  specified.  The  results  of  the  analysis  can  be  used  to 
determine  the  contents  of  stop  word  tables  and  dictionaries 
that  are  to  te  associated  with  these  fields.  If  the  system 
scan  subroutine  does  not  recover  words  as  ♦he  user  desires, 
a user-written  scan  subroutine  can  be  used  with  this 
utility.  All  the  words  contained  in  a data  base  field  can 
be  displayed,  or  those  words  which  are  irrelevant  (noise 
words)  can  be  selected  and  compared  to  the  words  in  th*= 
system  stop  word  table.  If  that  table  is  not  adequate,  the 
Dictionary  Maintenance  utility  can  be  used  to  build  a user 
stop  word  table.  Then  this  utility  is  able  to  list  all 
relevant  (nonstop)  words  which  can  be  used  to  determine 
dictionary  requirements,  if  a dictionary  is  not  employed, 
the  words  not  in  the  stop  word  table  will  all  appear  as 
keyword  entries  in  the  index  data  set.  Through  dictionary 
application,  synenomous  words  and  words  with  varying 
suffixes  can  be  collected  under  one  Index  Data  Set  entry, 
and  the  synonym  or  suffixed  form  can  still  be  used  in  a 
query  statement.  The  Dictionary  Maintenance  utility  can  be 
used  to  build  a dictionary  so  that  this  utility  can  produce 
d list  of  the  words  which  will  become  Index  Data  Set  entries 
together  with  the  keywords  (includirg  synonyms  and  suffixed 
words)  associated  with  them  which  can  be  used  as  query 
a rg  uments. 

# UTNDXKAN  processes  either  a SAM,  an  ISAM  or  a VSAM  data 
file.  The  fields  that  are  to  be  processed  are  specified  by 
control  statements.  For  each  field  specified,  the  utility 
obtains  from  the  control  statement  or  from  the  file  itself 
the  names  of  the  scan  subroutine,  stop  word  table  and 
dictionary  required  tc  process  that  field.  It  scans  all 
values  in  the  data  base  (unless  the  number  of  records  to  be 
processed  has  been  limited  by  the  user)  , optionally  matches 
the  recovered  words  to  a stop  word  table,  then  cpticnally 
matches  the  remaining  words  tc  a dictionary.  The  actual 
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f 'itic  performed  are  controlled  ty  accept  iny  names  to  FFT 

‘>ntr>  r.p“c  if  ications  or  by  specifying  EYP^S-S.  Overridi 
names  or  BYPASS  must  be  specified  for  all  functions  if  th( 
FFT  entry  does  not  indicate  keyword  indexing. 

HTNPYKAN  displays  word  lists  with  record  frequency 
counts  or,  optionally,  record  ide ctif ication s for  each  field 
processed  or  for  all  fields  as  a group,  ^reguency  count 
I "fleets  the  number  cf  MIPS  records  in  which  a word  appears 
at  l*^ast  once. 


1 h. 1 Input 

IITNDXKAM  accepts  FIIF  and  FIELD  control  statements.  The 
FILE  statement  is  opticnal.  At  least  one  field  statement  is 
required.  Control  statements  are  ceded  on  cards  cr  as  card 
images  and  are  contained  in  columns  1 through  71.  Each 
statement  must  begin  in  a new  record  with  the  statement 
identifier  FIIE=  or  FIELD=  in  column  1 of  that  record.  The 
file  cr  field  name  shall  immediately  follow  the  statement 
identifier.  A statement  that  exceeds  71  characters  can  be 
continued  on  one  or  more  additional  cards  in  columns  1 
through  7 1.  A nonblank  character  must  be  placed  on  column 
72  to  indicate  continuation.  A control  statement  can  be 
interrupted  after  any  comma  or  blank.  Words  may  not  be 
spli*^  be*-ween  records.  Cclumn  72  of  the  last  or  only  record 
of  each  control  statement  must  be  blank.  Columns  T3-fl0  of 
al]  lecords  are  ignored. 

A control  statement  operand  is  made  up  of  two  cr 
keyword  parameters.  Each  operand  must  be  preceded  and 
followed  by  one  or  more  blanks  or  commas  unless  an  operand 
*-f’iminates  in  coluitn  71,  in  which  case  a continuation 
character  (in  column  72)  may  follow  the  operand.  If 
muitijile  values  are  specified  for  an  operand,  at  least  one; 
blank  or  comma  must  separate  each  value  and  the  group  of 
values  must  be  enclosed  in  parentheses.  The  operands  can  be 
coded  in  any  order.  No  extra  commas  are  required  to 
indicate  omitted  operands. 
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14.1.1  FILE  Stateient 

The  FILE  stateoent  may  be  oraitted.  It  applies  to  file 
procG-ssinq  and  affects  all  the  fields  to  be  processed.  I^ 
may  appear  only  once  and  must  be  the  first  statement.  Its 
operands  alloh  control  of  file  access  and  output  mercing. 

The  statement  identifier  is; 


f 


FILF=f ilename  - name  of  file.  Must  be  coded  in  column 

1. 


The  statement  operands  are; 

HERGE=YES  - merce  the  word  lists  from  all  fields  into 
one  group  of  lists  that  reflects  the  entire  file. 


BYPASS=one  or  more  bypass  options  - valid  only  if 
MERGE=YES  is  specified.  It  defines  the  word  lists  to  be 
suppressed  for  all  fields  and  overrides  the  FIELD 
statement  EYPASS  operand.  The  display  lists  identified 
by  the  following  terms  are  omitted  from  the  output  for 
all  fields; 


STCF 

NONKEY 

K BYWORD 


- stop  word  table  matches 

- stop  word  table  and  dictionary  non- 
matches 

- dictionary  matches  including  synonym 
sublists 


SYNCSYH  - keyword  sufalists 

SUFFIXES  - dictionary  ncnmatches  which  are  com- 

posed of  keywords  with  valid  suffixes; 
the  keywords  appear  in  the  keyword  list. 


SKIP=nnnnn  - skip  nnnnn  NIPS  logical  records  before 
processing  any  fields,  where  nnnnn  is  a number  between 
1 and  32767. 
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fTOPAFT-nnnnn  - stop  after  processing  nnnnn  NIF5  logico' 
records,  where  nnnnn  is  a nunter  between  1 and  327t7, 


1 «. 1 .2  F lELD  Statement 

The  FIELD  statement  identifies  a field  to  he  analyzed. 
At  least  one  FIELD  statement  is  required  and  up  to  50  are 
allow  ed. 

""he  statement  identifier  is: 

FIELD®  fieldname  - name  of  field  or  variable  set.  f!u^. 
hr  coded  in  column  1. 

The  statement  operands  are: 

SCAN=naiBe  of  scan  subroutine  - identifies  the  scan 
subroutine  to  be  used  instead  of  the  FFT  scan  subroutine 
or  the  system  scan  subroutine. 

STOP=naae  of  stop  word  table  or  BYPASS  - overrides  th 
"FT  stop  word  table  specification  or  specifies  BYPASS  to 
cause  the  step  word  table  match  function  to  be  omitted 
for  this  field  in  which  case  all  recovered  words  are 
nenstop  werds. 

DICT-name  of  dictionary  or  BYPASS  - overrides  the  FFT 
dictionary  specifications  or  specifies  BYPASS  tc  caus- 
*•  he  dictionary  match  function  to  be  omitted  for  thi' 
field,  in  which  case  all  nonstop  words  are  keywords. 

HYPHEN=hyphen  option  - overrides  the  FFT  hyphen  cptir: 
specification.  Valid  options  are  TEXT,  DROP,  PETAIN  an''' 
SEPARATE. 

BYPASS*one  or  more  bypass  options  - not  applicable  if 
BYPASS  was  specified  on  a FILE  statement.  It  defines 
the  word  lists  to  be  suppressed  for  the  field.  The 
display  lists  identified  by  the  following  terms  are 
omitted  from  the  output  for  the  field: 

STOP  - stop  word  table  matches 


rn- 
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NONKEY 

- Step  word  table  and  dictionary  non- 
m at  ches 

KEYHC5D 

- dictionary  matches  including  synonym 
sub  lists 

SYNONYM 

- keyword  sublists 

SUFFIXES 

- dictionary  nonmatches  which  are 

cemposed  of  keywords  with  valid  suffixes; 
the  keywords  appear  in  the  keyword  list. 

FECin=yES  - specifies  that  reccid  identifications  are  to 
be  shown  in  word  lists  instead  of  frequency  counts. 


14.2  Output 

UTNDXKAN  displays  one  list  cf  words  with  either 
frequency  counts  or  major  record  identifications  for  each 
field  processed  or  for  all  fields  as  one  group  if  the  merge 
option  is  specified.  A two-character  code  associated  with 
each  word  identifies  its  type.  Herds  from  types  for  which 
bypass  is  specified  are  omitted  from  the  list.  If  a 
dictionary  was  specified  and  a data  word  matched  a convert 
synonym  or  was  suffixed,  the  dictionary  word  which  will  be 
substituted  fer  the  data  word  is  inserted  after  the  data 
word  at  an  offset. 


14.3  Jot  Setup 

The  following  JCL  statements  illustrate  the  deck  setup 
used  to  invoke  the  XKA  cataloged  procedure  for  a cataloged 
ISAM  file  and  a cataloged  user  library: 

//  EXEC  XK A, IS AHsfilen am9,LI B=libname 
//XKA.  SYS  IK  DD  * 

(user- supplied  control  statements) 

/* 
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whe  CP 

fil'^name  - nane  of  the  NIPS  ISAM  data  file 

libname  - nane  of  library  containing  user  scan 

subroutines,  stop  word  tables  and 
dictionaries. 

The  following  JCL  statements  illustrate  the  deck  setup 
used  to  invoke  the  XKA  cataloged  procedure  for  an 
unrataloged  SAM  file  and  an  uncatalcged  user  library; 


//  EXEC  XKA,SAM=filenaBe, VSAr='SER=aaaaaa' , 
//  LIE=libname,VLIE=*SER' btbbbb* 
//XKA.SYSIN  DD  * 

(user-  supplied  control  statements) 

/* 


whe  re 

f i lena  me 
d aaaaa 
1 ibnane 


ttbbbb 


name  of  the  NIPS  SAM  data  file 

serial  number  of  the  SAM  data  file 

name  of  the  library  containing  user 
scan  subroutines,  stop  word  tables,  and 
diet  ionar  ies 

serial  number  of  the  user  library. 


• The  follcwing  JCL  statements  illustrate  the  deck 
se<-u[)  us^d  tc  invoke  the  XKA  cataloged  procedure  for 
a VSAH  data  file  cataloged  on  a NIPS  user  catalog: 

# //  EXEC  XftA,VSCAT=niFCat, 

//  ISAH*f ilename,LIB=libnaie 
//XKA.  DAT  AFILE  EC  AMP=*AHORG' 

//XKA.SYSIN  DD  ♦ 

(user -supplied  control  statements) 

/* 
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whe  re ; 

# n i p c a t 

t filename 

# libname 


naie  of  NIPS  user  catalog  for  the 
VSAH  data  file 

name  of  the  NIPS  VSAM  data  file 

name  of  the  library  containirg 
user  scan  subrcutines,  stop  %ord 
tables,  and  dictionaries. 
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Section  16 

Format  Definition  Translator  Utility  (UTOCE) 


UTODE  is  used  to  place  format  definitions  cn  a user 
library.  A format  definition  gives  a description  of  a CRT 
display  format  and  the  Input  Message  Queue  records  to  be 
created  from  data  entered  on  the  display.  Before  a user  car; 
call  for  the  display  format  at  a CRT  terminal,  the  format 
definition  must  reside  cn  the  user  library.  UTOCE  creates 
skeleton  and  THQ  table  control  blocks  from  the  format 
definition  source  statenents  and  writes  the  control  blocks 
into  the  user  library  using  the  display  format  name  as  the 
member  name. 


16. 1 Input 

Input  to  UTCDE  will  consist  of  one  or  more  format 
definitions.  The  format  definition  source  statements  are 
described  in  Section  6 (FORMATTER)  of  the  lerminal 
Processing  users  Manual.  The  input  source  statements  may  be 
in  punched  cards  or  in  card  image  records  stored  in  a 
partitioned  data  set. 


16.2  Job  Setup 

The  following  JCL  statements  illustrate  the  deck  setup 
used  to  execute  UTODE.  In  the  first  setup,  the  input 
definition  source  statements  are  in  punched  cards. 

//AA  EXEC  XUTCDE,LIB=TEST160,VLIE='!5ER=MYPACK' 

//SYSIN  DD  ♦ 

Definition  source  statement  cards. 

/* 

The  following  JCL  would  be  used  if  the  input  were  card 
image  records  stored  in  a library. 
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//^B 

//5Y5IN 

// 

» // 

/* 


i — 


EXEC  XOTODE,LIB=TBST3  60,VLIB='SSR=!1YPACK  • 
DD  DSN  = MYLIB  (FOPNAT1 ) , VCL=SEP=(!YPACK2 
crsp=  (SHP,KEEP)  ,umT=2314, 

DCB={PECFB=FB ,LRECL=80,BLKSIZE=BOO) 
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